UniFuse: Unidirectional Fusion for 360° Panorama Depth Estimation
نویسندگان
چکیده
Learning depth from spherical panoramas is becoming a popular research topic because panorama has full field-of-view of the environment and provides relatively complete description scene. However, applying well-studied CNNs for perspective images to standard representation panoramas, i.e., equirectangular projection, suboptimal, as it becomes distorted towards poles. Another cubemap which distortion-free but discontinued on edges limited in field-of-view. This letter introduces new framework fuse features two projections, unidirectionally feeding only at decoding stage. Unlike recent bidirectional fusion approach operating both encoding stages, our scheme much more efficient. Besides, we also designed effective module scheme. Experiments verify effectiveness proposed strategy module, model achieves state-of-the-art performance four datasets. Additional experiments show that advantages complexity generalization capability.
منابع مشابه
360 Panorama Cloning on Sphere
In this paper, we address a novel problem of cloning a patch of the source spherical panoramic image to the target spherical panoramic image, which we call 360◦ panorama cloning. Considering the sphere geometry constraint embedded in spherical panoramic images, we develop a coordinate-based method that directly clones in the spherical domain. Our method neither differentiates the polar regions ...
متن کاملVirtual 360 Panorama for Remote Inspection
The use of remotely operated robotic systems in security related applications is becoming increasingly popular. However, the direct teleoperation interfaces commonly used today put a large amount of cognitive burden on the operators, thus seriously reducing the efficiency and reliability of these systems. In the context of an adjustable autonomy control architecture meant to relieve operators f...
متن کاملSnap Angle Prediction for 360$^{\circ}$ Panorama
360◦ panoramas are a rich medium, yet notoriously difficult to visualize in the 2D image plane. We explore how intelligent rotations of a spherical image may enable content-aware projection with fewer perceptible distortions. Whereas existing approaches assume the viewpoint is fixed, intuitively some viewing angles within the sphere preserve high-level objects better than others. To discover th...
متن کاملVirtual Reality Motion Parallax with the Facebook Surround-360 using a Depth Augmented Stereo Panorama
Recent interest in virtual reality has led to the development of 360-degree media platforms. In general, 360-degree images or videos can be observed using a head-mounted display (HMD) which tracks head position and renders images for each eye with low latency. Three-dimensional scenes can be portrayed by such displays by incorporating depth cues important to human perception of 3D position. Suc...
متن کامل3D Panorama Generation Using Depth-MapStitching
As the popularization and development of 3D display makes common users easy to experience a solid 3D virtual reality, the demand for virtual reality contents are increasing. In this paper, we propose 3D panorama system using vanishing point locationbased depth map generation method. 3D panorama using depthmap stitching gives an effect that makes users feel staying at real place and looking arou...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE robotics and automation letters
سال: 2021
ISSN: ['2377-3766']
DOI: https://doi.org/10.1109/lra.2021.3058957